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METHODS AND APPARATUSES FOR SUPERIMPOSITION OF IMAGES 

FIELD OF THE INVENTION 

The field of the invention is image projection in general, and electronic image 
5 projection in particular. 

BACKGROUND OF THE INVENTION 

U.S. Patent No. 5,386,253 to Fielding, incorporated herein in its entirety by 
this reference, discusses exemplary projection systems utilizing one or more spatial 
light modulators (SLMs). As noted in the Fielding patent: 

Spatial light modulator devices include so-called "active matrix" 
devices, comprising an array of light modulating elements, or "light valves," 
each of which is controllable by a control signal (usually an electrical signal) 
to controllably reflect or transmit light in accordance with the control signal. 
A liquid crystal array is one example of an active matrix device; another 
example is the deformable mirror device (DMD) developed by Texas 
Instruments .... 

See Fielding, col. 1,11. 13-21. Of course, yet other types of light "engines," or 
sources, and projectors exist, and various of them may be used in connection with the 
20 inventions described herein. 

Regardless of the type of projector used, audiences frequently desire to see 
images high in detail and richness and low in objectionable artifacts. High resolution 
and image quality in particular facilitates suspension of disbelief of an audience as to 
the reality of the projected images. Such quality indeed often is an important factor in 
25 the overall success of the motion picture viewing experience among today's 
audiences. 

Providing high resolution images to audiences can be prohibitively expensive 
in terms of producing the software, and in terms of the hardware necessary to show 
high resolution images. Imax Corporation, for example, the intended assignee of this 
30 application, utilizes not only specialized cameras and projectors, but also seventy 

millimeter, fifteen perforation film to increase the resolution and quality of projected 
images. 
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In some venues, it is desirable to be able to display high resolution moving 
picture images that are non-film based, sucb as computer generated graphics, or 
material captured with electronic cameras. It is particularly prohibitive to display 
these kinds of high resolution images using conventional electronic projectors (and 
5 especially those utilizing SLMs) because it is not technically or economically feasible 
to produce the necessary spatial light modulators (SLM) at sufficient resolution to 
match the high resolution of the source material. As well, such electronic projectors 
frequently fail to furnish the dynamic range and overall brightness of images provided 
by large-format films. 

1 0 In one solution to achieve the desired resolution, conventional electronic 

projection systems have employed "tiling" techniques. Tiling involves the useof 
multiple projection displays of sub-images that are displayed adjacent to each other to 
form a composite image. The use of multiple projection displays allows for greater 
resolution than is available with a conventional single projection display. Thesub- 

1 5 images can be blended inside a single projector or if multiple projectors are used, the 
sub-images are blended on the screen. For example, when two projectors are used 
one projector projects a first sub-image on a screen. A second projector projects a 
second sub-image on a screen. The first and second projectors are positioned such 
that the first and second sub-images are projected onto a screen adjacent to each other. 

20 It is difficult to align the projectors exactly and therefore undesirable seams 

between the first and second sub-images are often apparent to the viewer. To improve 
the appearance and continuity of the composite image, the first and second projectors 
are conventionally positioned such that the first image slightly overlaps the second 
image. Mere overlapping of sub-images typically is insufficient, however, as the 

25 additive intensity of the images in the regions of overlap in some scenes likewise may 
be noticeable to audiences. General methods of reducing brightness in these regions 
require careful matching of the displays at the seam area(s), both geometrically and 
photometrically. 

Another approach is to combine or superimpose two or more sub-images by 
30 off-setting two or more SLMs by, for example, one half of a pixel. With this 

approach, the sub-images are simultaneously displayed and the pixels of one spatial 
light modulator are positioned to lie between the spaces of the pixels of another SLM. 
This approach is discussed in U.S. Patent No. 5,490,009. A disadvantage of this 
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approach is that it requires twice the number of SLM devices while the resulting 
combined resolution of the two SLMs is limited to being less than a factor of two 
horizontally or vertically. This is because there is always some overlapping of 
superimposed pixels since for reasons of uniformity and efficiency it its desirable that 
5 the pixels be as nearly equal to 1 00% of the space allowed by their pitch as possible. 
This effectively limits the gain in resolution to about the square root of two 
horizontally or vertically, which produces an overall increase in the number of pixels 
of about 2.8 times. 

There are also times when it is desired to produce stereoscopic or three 
1 0 dimensional (3D) images with an electronic projector. Typically the projection of 
stereoscopic or 3D images requires two separate image projectors, one dedicated to 
projecting left eye images, and the other dedicated to projecting right eye images. 
This requirement, when combined with a superimposition technique that doubles the 
number of required SLMs in order to produce the necessary high resolution can be 
15 cost prohibitive. 



SUMMARY OF THE INVENTION 

In one embodiment of this invention, two sub-images for superimposition are 
created using a single spatial light modulator. A first sub-image is projected with the 

20 SLM at a first position and, during the same frame, a second sub-image is projected 
using the same SLM. In one embodiment, micro-actuators are used to move the SLM 
from the first to the second position. The SLM is subsequently moved back to the 
first position for the projection of the next image frame. The first and second position 
of the SLM are such that the two resulting sub-images are offset by one half of a pixel 

25 in both horizontal and vertical directions, allowing the two subimages to combine to 
produce a final image having a greater resolution than that provided by the actual 
pixels contained in the SLM. 

The first and second projection positions may be discreet static positions, or 
they may be continuously varying dynamic positions, such as the crest and trough 

30 portions of a sinusoidal motion profile. 

In another embodiment, high resolution, stereoscopic images are created using 
the principle of temporal superimposition and an electronic projection system having 
a minimum of low resolution SLMs. The invention alternately projects offset image 
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sub-fields to each eye. which are then combined by the human visual system into a 
single, integrated high resolution image. The human visual system similarly 
integrates the separate left and right eye images into a single, 3D image. 

5 BRIEF DESCRIPTION OF THE DRAWINGS 

Figs. 1 to 3 are schematic block diagrams illustrating the general structure of 
an active matrix projection system. 

Fig. 4 is an illustration of a spatial light modulator in accordance with the 
invention at a first display position. 
10 Fig. 5 is an illustration of the spatial light modulator in accordance with the 

invention at a second display position. 

Fig. 6 is a close up of the pixels of a spatial light modulator illustrating the 
superimposition of pixels to create a higher effective resolution. 

Fig. 7 is a schematic illustrating the means by which a SLM may be moved 
1 5 from one position to another in accordance with the invention. 

Figs. 8 and 9 illustrate two motion profiles of the SLM. 

Figs. 10 and 1 1 illustrate two path profiles of the SLM. 

Fig. 12 is a schematic of the arrangement of spatial light modulators and optics 
of the inventive method and apparatus. 
20 Fig. 13 is a timing diagram of the sub-images projected by the novel projector. 

Fig. 14 is a timing diagram of the state of polarization of each of the lenses in 
the pair of electronic glasses. 

Fig. 15 is a timing diagram of the sub-images projected by the projector in an 
alternate embodiment. 

25 Fig. 16 is a timing diagram of the alternate eye glasses associated with the 

alternate embodiment depicted in Fig. 15. 

Fig. 17 is a schematic of an embodiment of a projector incorporating an 
electrically controllable wave plate. 

Fig. 18 is a diagram of the polarization of light produced by the projector of 
30 Fig. 17. 

Fig. 19 is a timing diagram of the sub-images projected by the projector of 

Fig. 17. 
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DETAILED DESCRIPTION 

Referring to Fig. I, a projection system comprises a reflective screen (for 
example a cinema screen) 10 and a projector 12, positioned and aligned relative to the 
screen so as to generate a focused image on the screen 10. 
5 The projector 12 comprises a lamp 13, typically rated at several kilowatts for a 

cinema application, generating a light beam which is directed onto a planar active 
matrix display device 14 comprising, for example, a DMD array of 512 x 512 
individual pixel mirrors. Each mirror of the display device 14 is individually 
connected to be addressed by an addressing circuit 1 5 which receives a video signal in 

1 0 any convenient format (for example, a serial raster scanned interlaced field format) 
and controls each individual mirror in accordance with a corresponding pixel value 
within the video signal. The reflected and modulated beam from the active matrix 
device 14 (or rather, from those pixels of the device which have been selectively 
activated) is directed to a projector lens system 16 which, in a conventional manner, 

1 5 focuses, magnifies and directs the beam onto the screen 10 as shown schematically in 
Fig. 2. 

For a color system, three separate active matrixes as shown in Fig. 3 or three 
separate lamps with one SLM and a combining prism can be used. Other color 
systems are also known. 

20 Referring now to Fig. 4, there is illustrated a spatial light modulator (SLM) 30 

having a plurality of pixels 32 arranged in a grid of rows and columns. SLM 30 could 
be a deformable mirror device, (DMD) such as that sold by Texas Instruments, in 
which each of the pixels is actually micro-steerable mirrors which can be toggled 
between an off-state and an on-state in rapid succession, as is necessary to display an 

25 image onto a projection screen. The total number of pixels in a DMD device is 

typically limited by technological and economic factors, and commercially available 
DMD chips are not capable of projecting very high resolution images such as those 
that are associated with 70 mm motion picture film. 

In one embodiment of this invention, a single SLM is used to project two sub- 

30 images during a single frame where the sub-images are offset by a some portion of a 
pixel. Fig. 5 shows SLM 30 in the two projection positions. Position 33 is indicated 
by ghost outline, whereas position 34 is indicated by the solid black lines. Position 34 

5 
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is an offset of position 33 by, for example, slightly less than one pixel horizontally 35 
and vertically 36. 

Fig. 6 is a close up of pixels in the two positions illustrating how the pixels at 
the second position are positioned to be in the spaces between the pixels at thefirst 
5 position. The dark pixels, 51 are indicative of the pixels at the second position, 
whereas the lighter cross-hatched pixels 41 are indicative of the pixels at the first 
position. The two sub-images created by projection images at the two different 
positions, even though displaced in time, are combined by the human visual system 
into a single coherent image, in a manner similar to that in which separate images, 

10 projected rapidly are perceived as a smoothly moving image. 

In Fig. 7. a SLM 30 is schematically shown to be connected with two linear 
actuators, Ah and A v and to two springs, Sh and Sv The springs, Sn and Sv, act to 
bias SLM 30 in position 33 - S H in the horizontal direction and S v in the vertical 
direction. Actuator A H acts to move SLM 30 in the horizontal direction and actuator 

1 5 A v acts to move SLM 30 in the vertical direction. Actuators Ah and A v act together 
to move SLM 30 from position 33 to position 34. Actuators A H and A v may be 
piezoelectric actuators, such as those supplied by Physik Instrumente GmbH of 
Germany, which are capable of precise positioning down to the subnanometer range. 

This example is illustrative only, and other means know to those skilled in the 

20 art may be used to move the SLM from a first position to a second position. 

Additionally, the sub-images could be generated by moving other components within 
the projection system, other than the SLM. For example, a mirror or a group of 
optical elements such as a 1:1 relay carrying the image from the SLM within the 
projector could be moved between two positions thereby creating two complementary 

25 sub-images when projected onto the screen. 

In Fig. 8 a timing diagram is shown illustrating linear motion of a SLM 30 
from a first position indicated by 70 to a second position indicated by 72. At 70 and 
72 the SLM 30 is stationary for the duration of the sub-frame projection period. The 
periods 71 and 73, represent the time required for the SLM 30 to travel from the first 

30 position to the second position, and back again. The sum of the periods 70 to 73 is 
equivalent to one normal frame in motion picture projection - typically 1/24 of a 
second or approximately 41 milliseconds. A projector incorporating the inventive 
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method should be capable of displaying images at twice the normal frequency, or 
frame rate. 

In Fig. 9 a timing diagram is shown illustrating a sinusoidal motion profile in 
which the SLM 30 never comes to a discreet stop, but is in continuous motion from 
5 one position to the other. The motion profiles are designedso as to maximize the 
time when the SLM is essentially stationary (Tl and T2 in the diagram) without 
requiring the mechanical system to bring it to a complete stop. 

Figures 10 and 1 1 illustrate two possible motion paths for moving the SLM 
from one position to the other. In Fig. 10 a single pixel is shown in each of the two 
10 extreme positions and a linear path of motion for the pixel is shown. A linear path is 
produced, for example, by the actuators. A H and A v . in Fig. 7 moving in the 
respective directions at the same time and at the same rate. Figure 1 1 illustrates an 
elliptical path of motion, which may be desirable for reasons of mechanical durability. 
This elliptical path is produced, for example, by the actuators, A H and A v . in Fig. 7 
1 5 moving in their respective directions at varying rates and times. 

Referring now to an alternative embodiment illustrated in Fig. 12, a projector 
100 is depicted schematically and is comprised of six separate SLMs, grouped in two 
sets of three, each group having its own combining prism. Prism 102 has separate red 
103R, green 103G and blue 103B SLMs. Prism 102 combines the light of each of the 
20 three separate SLMs into one full color light beam, which exits in the direction 

indicated by arrow S. Similarly, prism 104 has separate red I05R, green 105G, and 
blue 105B SLMs. Prism 104 combines the light of each of the three separate SLMs, 
which exits in the direction indicated by arrow P. 

The light from both prisms 102 and 104 is directed towards a polarizing beam 
25 splitter, 106. as seen in Fig. 12. The light from prism 102 becomes linearly polarized 
in an "s" orientation, and the light from prism 104 becomes linearly polarized in an 
orthogonal, or 4i p" orientation. 

Prisms 102 and 104 are offset slightly in relation to each other, so that images 
formed by each can be superimposed on the screen thereby creating composite images 
30 that have a higher overall resolution than one generated by either prism alone. 
Typically, the prisms and/or SLMs are oriented so that the output ofone prism is 
offset by one half of a pixel vertically, horizontally or both. 
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Electronic glasses, 107, as seen in Fig. 12, are provided to audience members 
in order to decode the spatial and temporal multiplexing of the images as produced by 
the projector. 

The glasses have liquid crystal lenses, 108 and 109, which can be alternately 
5 switched between two orthogonal states of polarization. Such liqu id crystal lenses are 
similar to those used in alternate eye 3D electronic glasses, such as those used by 
lmax Corporation, except they lack a front polarizer, which is commonly included 
with liquid crystals to enable them to operate as alternately transmissive and opaque 
shutters. 

10 A timing diagram is depicted in Fig. 13, which shows the sequencing of 

images produced by the two separate prisms within projector 100. Referring now to 
the output of prism 102, a first right (R) eye sub-field is projected onto the screen 
during the first portion of frame 1 . The duration of one frame is typically 1/24 second 
(or 40.3 milliseconds). The output of prism 102 is then switched to provide a sub- 

1 5 frame intended for the left (L) eye. Similarly, the output of prism 1 04 alternates 
between a first left (L) eye sub-field, followed by a right (R) eye sub-field. The 
polarization of the images from prism 102 is "s" and the polarization of the images 
from prism 104 is "p'\ 

Figure 14 depicts a timing diagram which indicates the state of polarization of 

20 the lenses in the glasses worn by viewers. During the first half of a frame period, the 
left eye lens transmits the light produced by prism 104, and blocks the light produced 
by prism 102. As shown in Fig. 14, this is accomplished by setting the polarity on the 
left eye lens to "p". Thus, letting in all the light polarized in the p direction and 
keeping out all of the light polarized in the s direction. In the second half of the frame 

25 period, after the polarization of the left lens has been switched, it transmits the light 

produced by prism 102, and blocks the light produced by prism 104. Similarly, this is 
accomplished by changing the polarity on the left eye lens to "s". Thereby, the left 
eye lens lets in all the light polarized in the s direction and blocks light polarized in 
the p direction during the second half of the frame. As can be seen in Fig. 14, the 

30 right eye lens in the glasses is operated out of phase with the left eye lens- letting in 
light polarized in the s direction during the first half of the frame and letting in light 
polarized in the p direction during the second half of the frame. The operation of the 

8 



BNSDOCIC <WO 016S342A2J_> 



WO 01/69942 

PCT/IBOl/00347 

lens allows each eye to see the images intended only for it, thus allowing the human 
v.sual system to integrate the two sets of images into a three dimensional image. 

Since the light output by prisms 102 and 104 are offset relatively, the 
composite image can be temporally fused by the human visual system, resulting in the 
5 perception of a higher resolution image than the images produced by either prism 
alone. Experiments have shown that temporal fusing can occur if the switching 
between sub-images is fast enough. Typically the overall resolution can be improved 
by a factor of about 1 .4. 

In another embodiment, the timing profile is changed so that the frequency of 
1 0 subframes is increased, for example by a factor of two, so that each sub-frame is 
displayed for a period of about 10 msec. 

In yet another embodiment, the offset sub-fields are presented simultaneously 
to one eye, while the other eye is blocked by an opaque shutter. Here the polarizing 
beam splitter is replaced by an alternative method that does not relv on polarization to 
1 3 combme the two images. The eyeglasses act to direct the light from both sub-fields to 
the appropriate eye. In the subsequent time period, the first eye is blocked by a 
shutter, and the other eye is presented with two offset sub-fields simultaneously The 
eyeglasses required by this embodiment are standard alternate-eye electronic liquid 
crystal shutter glasses. This embodiment is illustrated in Figures 1 5 and 16. 
20 In an alternative embodiment, viewers wear passive glasses in which the 

lenses are mutually orthogonal linear polarizers. An active alternate phase % wave 
plate (such as a Ferroelectric Liquid Crystal) is located at the projector and switches 
the polarization of the light by 90 degrees every half frame (approximately 20 msec.) 
Fig. 1 7 depicts a projector 1 1 0 with lens 11 2 incorporating an electrically 
25 controllable wave plate 1 1 1 located prior to the lens. The wave plate could 

alternatively be located after the lensas illustrated by the dashed lines 113. This 
projector produces the two overlapped images from prisms 102 and 104 (not shown in 
Fig. 17, but shown in Fig. 12) onto screen 1 14. Fig. 18 illustrates how the switching 
of the polarization of 1 11 (or 1 1 3) causes the light that reaches the screen 1 14 to 
30 alternate in polarity, corresponding alternately to the images from prisms 102 and 
104. 

Fig. 1 9 illustrates the switching arrangement for the sub-images presented to 
prisms 102 and 104, and the switching of the polarity of 1 1 1 (or 113). The 
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controllable wave plate 1 1 1 (or 1 13) switches at two times the frame rate 
(approximately 20 msec, for 24 frames per second) and prisms 102 and 1 04 carry the 
appropriate eye sub-image at each time. 

In all cases it should be noted that the while a frame rate of 24 fps.is typical 
5 for motion picture films, other frame rates are commonly employed and may be used 
without departing from the spirit of the invention. It should also be noted that visual 
fusion of the sub-images is improved by higher frame rates, and this will contribute to 
an improvement in the quality of the results obtained from the temporal 
superimposition. 

10 The foregoing is provided for purposes of explanation and disclosure of 

preferred embodiments of the present invention. For instance, a preferred 
embodiment of this invention involves using a deformable mirror device as the spatial 
light modulator. It is expected that such capabilities or their equivalent will be 
provided in other standard types of spatial light modulators, in which case the 

15 preferred embodiment of this invention may be easily adapted for use in such systems- 
Further modifications and adaptations to the described embodiments will be apparent 
to those skilled in the art and may be made without departing from the scope or spirit 
of the invention and the following claims. 
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What is claimed is: 

II. A method of enhancing the resolution of a spatial light modulator (SLM)- 

2 based display system having optics, comprising: 

3 (a) projecting a first sub-image using an SLM during a frame; and 

4 (b) projecting a second sub-image offset from the first sub-image using the 

5 SI M during the frame. 



1 2. The method of claim 1 wherein the first sub-image is offset from the second 

2 sub-image by less than one pixel. 



1 3. The method claim I wherein the first sub-image is offset from the second sub- 

2 image by moving the optics in the projection system. 

1 4. The method claim 1 wherein the first sub-image is offset from the second sub- 



image by moving the SLM from a first position to a second position. 



15. The method of claim 4 wherein the SLM is biased in the first position by at 
2 least one spring and is moved from a first position to a second position by at least one 



j> actuator. 



1 6. The method of claim 4 wherein the SLM moves from the first position to the 

2 second position in a linear motion. 

1 7 The method of claim 4 wherein the SLM moves from the first position to the 

2 second position in a non-linear motion. 

1 8. A method of enhancing the resolution of a spatial light modulator (SLM)- 

2 based display system, comprising: 

3 (a) projecting a first sub-image using an SLM at a first position during a 

4 frame; 

5 (b) moving the SLM from the first position to a second position during the 

6 frame; and 
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7 (c) projecting a second sub-image using the SLM at the second position 

8 during the frame, wherein the first and second sub-images are offset. 

1 9. The method of claim 8 wherein the first sub-image is offset from the second 

2 sub-image by less than one pixel. 

1 10. The method of claim 8 wherein the SLM is biased in the first position by at 

2 least one spring and is moved from a first position to a second position by at least one 

3 actuator. 

1 11. The method of claim 8 wherein the SLM moves from the first position to the 

2 second position in a linear motion. 

1 12. The method of claim 8 wherein the SLM moves from the first position to the 

2 second position in a non-linear motion. 

1 13. A spatial light modulator (SLM)-based display system comprising: 

2 a light source; 

3 a spatial light modulator; 

4 an addressing circuit electrically coupled to the spatial light modulator, 

5 wherein the addressing circuit controls the spatial light modulator; 

6 at least one biasing spring connected to SLM for biasing SLM in a first 

7 position during a frame; and 

8 at least one actuator connected to the SLM and electrically coupled to the 

9 addressing circuit, wherein the actuator receives signals from the addressing circuit to 
1 0 move the SLM to a second position during the frame. 

1 14. The system of claim 13 wherein the SLM projects a first sub-image in the first 

2 position and projects a second sub-image in the second position, wherein the first sub- 

3 image is offset from the second sub-image. 

1 15. The method of claim 14 wherein the first sub-image is offset from the second 

2 sub-image by less than one pixel. 

12 



BXSDOCID: <VVO 0ieS342A2_:_> 



WO 01/69942 PCT/1B01/00347 



0 



10 



1 6. A method of producing stereoscopic images in a spatial light modulator 
(SLM)-based system having a single projector, comprising: 

3 (a) creating a first sub-image, with at least a first SLM, in the projector; 

4 (b) creating a second sub-image, with at least a second SLM, in the 

5 projector; 

6 (c) combining the first sub-image and the second sub-image such that the 

7 first sub-image is linearly polarized in a first orientation and the second sub-image is 

8 linearly polarized in a second orientation; and 

9 (d) projecting the combined first and second sub-images on a screen, 
wherein the first and second sub-images are superimposed and the second sub- 

I 1 image is offset from the first sub-image on the screen. 

1 17. The method of claim 1 6 further comprising allowing only the sub-image 

2 intended for a viewer's first eye to be viewed by the first eye and allowing only the 

3 sub-image intended for a viewers second eye to be viewed by the second eye. 

1 1 8. The method of claim 1 6 further comprising setting the polarization in a right 

2 lens of a viewer's glasses to the first orientation and setting the polarization in a left 

3 lens of a viewer's glasses to the second orientation during the frame; and changing the 

4 polarization in the right lens to the second orientation and changing the polarization in 

5 the left lens to the first orientation during the frame. 

1 1 9. The method of claim 1 6 further comprising allowing a viewer to see both sub- 

2 images with a first eye and blocking the view of the sub-images to a second eye 

3 during a frame; and allowing the viewer to see both images with the second eye and 

4 blocking the view of the sub-images to the first eye. 

1 20. The method of claim 1 6 wherein each sub-frame is displayed for half of a 

2 frame. 



1 21 . The method of claim 16 wherein the first sut>image and the second sub-image 

2 are superimposed on a screen. 
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1 22. A method of producing stereoscopic images in a spatial light modulator 

2 (SLM)-based system having a single projector, comprising: 

3 (a) creating a first sub-image with at least a first SLM in the projector; 

4 (b) creating a second sub-image with at least a second SLM in the 

5 projector; 

6 (c) combining the first sub-image and the second sub-image; and 

7 (d) projecting the combined first and second sub-images on a screen, 

8 wherein the first and second sub-images are superimposed and the second sub-image 

9 is offset from the first sub-image on the screen; and 

1 0 (e) switching the polarization of the sub-images at a predetermined time. 

1 23. The method of claim 22 wherein the polarization of the sub-images is 

2 switched at two times the frame rate. 

24. The method of claim 22 wherein the polarization of the sub-images is 
controlled by an electrically controllable wave plate. 
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